HAUSDORFF DIMENSION OF THREE-PERIOD ORBITS 
IN BIRKHOFF BILLIARDS 
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Abstract. We prove that the Hausdorff dimension of the set of three- 
period orbits in classical billiards is at most one. Moreover, if the set of 
three-period orbits has Hausdorff dimension one, then it has a tangent 
line at almost every point. 



1. Introduction 

The goal of this note is to provide a sharp estimate on the dimension of 
the set of three-period orbits in classical billiards. The question about 
Lebesgue measure of the set of periodic orbits was raised by Ivrii [i4j, in 
connection with spectral geometry problems. The conjecture that periodic 
orbits have zero measure is still open, but several special cases have been 
resolved. The first result was due to Rychlik [6J who proved that the set of 
three-period orbits has zero Lebesgue measure. More recently a proof for 
the four-period case has been announced in [2]. 

Consider a not necessarily convex billiard boundary and define the billiard 
map T in the standard way. The boundary of length / is parametrized with a 
natural parameter t. For an outgoing trajectory, let 9 be the angle with the 
tangent. Then the billiard map T{ti, 9i) = (^2, ^2) is defined for any segment 
that is transversal to the boundary at both ends. We disregard those that 
are not, since they have zero measure. The billiard map is defined on an open 
annulus U = x I, where is the boundary of length / and / = (0,7r). 
The billiard map preserves the measure fj, = sm{6)d6 A dt, see, e.g., |8]. 

Rychlik's proof was simplified in [7J , [9j , and [5j , see also a survey article 
[3]. In [5], Wojtkovski proved Rychlik's theorem using Jacobi fields. He first 
proved that if there is a neighborhood containing only three-period orbits, 
then the identity 

k{t) ■ L{t,9) = 2sm^{e) 

must hold, where k{t) is the boundary curvature and L{t, 9) is the length of 
the three-period orbit {t,9). By Fermat's principle, the length is extremized 
by the actual orbits, and thus L{t,9) is constant for any continuous family 
of orbits. The contradiction is easily derived by observing that, by varying 
9, the right-hand side will change while the left-hand side will be constant. 
Wojtkovski, following Rychlik [6], extended the contradiction to the case 
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when the set P has positive Lebesgue measure. The argument rehes on 
the presence of a Lebesgue density point in whose neighborhood one can 
differentiate the above identity in 9, arriving at a contradiction again. 

A natural question arises as to how optimal this result is. Clearly, peri- 
odic orbits can form a one-parameter family, e.g., in a billiard with circular 
boundary there is a one dimensional set of three-period orbits, so the Haus- 
dorff dimension can be equal to one. But can this set have the Hausdorff 
dimension between one and two? Note that for the two-period orbits the an- 
swer is clearly no, since such orbits must be normal to the boundary. Thus, 
9 = it/2 and the set is confined to the one-dimensional line segment. 

Our main result states that the similar sharp bound holds for the three- 
period orbits. 

Theorem 1.1. If the billiard boundary is C^, then the Hausdorff dimension 
of the set of three-period orbits is not more than one, i.e., 

W{P^) = if s > 1, 

where H'^ denotes the Hausdorff s-dimensional measure. 

In the case when the Hausdorff dimension is equal to one, there is more 
information about the structure of the set P^, exhibited by the following 
theorem. See Section [3] for the definitions. 

Theorem 1.2. Assume the billiard boundary is C"^ and dim-^i(P^) = 1. 
Then the set P^ has a tangent line at H^ -almost every point p £ P^. 

Note that in the case of two-period orbits the analogous statement holds 
for the above reason: P^ is confined to the line segment 9 = 7r/2. 

The paper is organized as follows. Section[2]contains an elementary lemma 
on existence of a sequence converging to an accumulation point of a given 
set and that is asymptotic to a certain direction. It also provides an elemen- 
tary formula for a directional derivative of a map via a sequence of points 
accumulating asymptotically in the given direction. In Section |3] we define 
and develop the relevant notions from measure theory, mostly based on [IJ. 
In the last section we apply those results to prove main theorems on the 
structure of the set of three-period orbits. 

2. Derivatives along sets 

For two points p and g in M^, we denote by |p — g| the Euclidean distance 
between them. If E and F are two subsets of M^, we denote by dist(£', F) the 
distance between them. We also denote by diam(£') the Euclidean diameter 
of a set C M^. Finally, let B{p,r) denote the closed disc in centered 
at p of radius r > 0. 

For 7 € M and p,r] > 0, we consider the circular sector 

Wpir,P,v) = {q = P + te'':0<t<p,\9-j\<ij}. 
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Lemma 2.1. Let E be a subset of the disc B{p, r) C M^. Assume that F is a 
closed subset of the boundary circle dB{p,r) such that p is an accumulation 
point for E n Cp, where Cp is the cone over F, i.e., 

CF = {qe B{p, r):q=p + te'^ , re'^ £ F, t £ [0, r]}. 

Then there exist a ray R, emanating from p and passing through a point 
in F , and a sequence (pk) with pk G E \ {p}, limpk = p, such that (pk) is 
asymptotic to R, i.e., 

lim '^pPh^ = 0. 

k^oo \pk - p\ 

Proof. For every n E N, we consider the open cover 

Gn = {Un{7):re'^ eF} 

of F, where 

Unh) = {re'' : ^ G (7 - 1/2", 7 + 1/2")}- 
Since F is compact, Gn contains a finite subcover, denoted Gn{F). Let 

^n(i^) = {t/n(7^),...,C/n(7^^"^)}. 

We assumed that p is an accumulation point for EnCp- Therefore, for ev- 
ery n E N, there exists 7„ E {7^, . . . ,7)^*'"^}, such that p is an accumulation 
point for 

^nTyp(7„;l/n,l/2"). 

Moreover, we may assume that for each n E N, we have re*'''"+i E Uni'Jn), 
the closure of f/n(7n)- Indeed, En = Fn C/„(7„) is a compact set such that p 
is an accumulation point for ECiCp^. Thus the sequence (re*'^") converges 
to re'^^°° . Note that re*'^°° E F. 

Let R be the ray emanating from p and passing through the point re*'''°° . 
From the above, we know that there exists a sequence (pn), Pn & E \ {p}, 
such that 

Pn e VFp(7„;l/n,l/2"). 
Since lim 1/n = 0, we conclude that limp„ = P- Finally, 

dist(p„,i?)^^. /^^ - 1 \ fc^oo. □ 



\Pn-p\ ~ \2" ^^2"+i) V2" 

The following lemma is elementary. 

Lemma 2.2. Let p be an arbitrary point in and let [/ C R-^ be a neigh- 
borhood of p. Suppose that F:U^M.orM? is a -dijjerentiable map in 
U. Let \r be a unit vector in M'^ and R be a ray emanating from p in the 
direction of v. We assume that {pk) is a sequence in U \ {p}, such that 



limfc_>ooPfc = P o-nd (pk) is asymptotic to R in the sense of Lemma 2.1 
Then for the directional derivative Fv{p) = DpF{v), where DpF denotes 
the differential of F at p, we have 

fc^oo \pk - p\ 
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Proof. For A; G N, let qk be the projection of pk onto R. Then 

F{qk) - F{p) 



k^oo \qk — p\ 



On the other hand, 



Fjpk) - F{p) ^ Fjqk) - F{p) ^ F{pk) - F{qk) ^ ^ ^ 
\Pk-p\ \qk - p\{l + o{l)) \Pk-p\ 

because {pk) is asymptotic to R. Also, since F G in [/, it is Lipschitz in 
a neighborhood of p. Therefore there exists L > such that 

\F{Pk) - F{qk)\ < L\pk - qk\ = Ldist{pk,R), 

for all k large enough. By passing to the limit in ([T]) and using the assump- 
tion that {pk) is asymptotic to R, we obtain the desired formula for the 
directional derivative F^{p). □ 



3. Measure theory 
Let F C M2 and < s < oo. For 5 > we define 

-?^|(F) =inf^diam"(C/i), 

where the infimum is taken over all covers {[/j: i G /} of £^ with < 
diam(J7j) < 5, i & I. The Hausdorff s- dimensional outer measure of E is 

n'iE) = lim niiE). 

The Hausdorff s-dimensional outer measure is indeed an outer measure^ i.e., 
'H^(0) = 0, 'W is monotone and subadditive. It is also a metric outer 
measure., i.e., if E and F are two subsets of with dist(£', i^") > 0, then 

WiEvjF) = n\E)^n\F). 

Therefore we have the following consequence. 

Lemma 3.1. [T, Theorem 1.5] All Borel sets are Ti^ -measurable. 

It is easy to see that for any E (^M?, the function T-l^{E) is non-increasing 
in s. Furthermore, there exists a unique value sq such that T-L^{E) = oo for 
< s < So and W{E) = is s > sq. The value sq is called the Hausdorff 
dimension of E, and it is denoted dim-^(ii^). An s-set ii^ C is an Ti^- 
measurable set with < T-L^{E) < oo. It is immediate that if E is an s-set, 
its Hausdorff dimension is s. 

Theorem 3.2. [T, Theorem 5.4(a)] Let E CM? be a closed set with W{E) = 
oo. Then for every c > 0, there exists a compact subset F C. E such that 
H^iyF) = c. In particular, F is an s-set. 
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If ii^ is a 7^^-measurable set in M?, we say that F C. E is a full measure 
subset if T-L^{E \ F) = 0. Also, if ii^ is a 7^^-measurable set, we say that a 
property holds at T-L^- almost all points of E, or at T-L^- almost every point of 
E, if there exists a full measure subset F <^ E such that the property holds 
at every point of F. 

If £^ C is a "^^^-measurable set and p G M^, the lower and upper density 
of -E at p are defined as 

, . ^n%EnB{p,r)) . n%EnBip,r)) 
Ds{E,p) = hmmf ; ^, D'{E,p) = limsup ; ^, 

respectively. If -E is an s-set, a point p £ E such that Ds{E,p) = D'^{E,p) = 
1 is called a regular point of E. Otherwise p is called an irregular point. 

Lemma 3.3. [U Corollary 2.5] If E is an s-set in M^, then 

^ < D%E,p) < 1 

at 'H'^ -almost all p in E. 

For 7 € M and r/ > 0, we also define the upper angular density of E at p 

as 

D [E, p, 7, r/ = hm sup — — . 

A 'H*-measurable set C has a tangent line at p in direction 7 G M if 
D^(E,p) > and if for every r] > 0, 

j.^ n%E n r) \ {Wpir, r, y) U Wp{^ + tt; r, 7?)))) ^ ^ 

r->0+ r'^ 

We recall that Wp{'~f; p, r]) is the circular sector 

{q=p + te^^ :0<t<p, -f-r]<e<-f + r]}. 

Lemma 3.4. [H Lemma 4.5] If 1 < s < 2 and E is an s-set in M^, then for 
Ti^ -almost all p £ E we have 

D'{E,p,j,r]) < 4 - lO'r?"-^ 

for all J and r] < 7r/2. 

Corollary 3.5. // 1 < s < 2 and E is an s-set in , then at H.'^ -almost all 
points of E no tangent line exists. 

Proof. The sub-additivity of gives 

n%E n B{p, r)) < W{E n W^ir, r, r?)) + n'{E n VFp(7 + tt; r, r?)) 

+n'{Er\ {B{p, r) \ {Wp{r, r, r/) U WjXl + ^; r, r?)))) 

for all 7 E M and 77 > 0. 

Suppose that E has a tangent line 7 at p. Then, by dividing both sides 
of Q by (2r)* and taking limsup as r — )• 0+, we conclude that 

D'{E,p) < D%E,p, 7, r?) + D'{E,p, 7 + vr, ??) 
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for all 7 G M and ry > 0. By applying Lemma 3.4, we further obtain 

for all r] < Tr/2 and 'H^-almost sdl p £ E such that E has a tangent line 



at p. Since s > 1, this gives D'^{E,p) = 0. An application of Lemma 3.3 



concludes the proof. □ 

Corollary 3.6. // 1 < s < 2 and E is an s-set in M? , then at -almost all 
points p £ E we have 

Q ^ j.^^^p n%E n {B{p, r) \ {W,,{t, r, U W,{^ + vr; r, 77)))) ^ 
/or all ^ and some rj > 0. 

Proof. The right-hand side inequality follows from the monotonicity oiH" 
and Lemma |3.3[ The left-hand side inequality holds for every p £ E such 



that D'^(E,p) > and E has no tangent line at p. Lemma 3.3 and Corol- 
lary 3.5 imply that the set of such points has full T^'^-measure. □ 

Theorem 3.7. Let E C R'^ be an s-set, 1 < s < 2. Then for W-almost 
every point p of E there exist two rays Ri and R2, emanating from p and 
not contained in the same line, and two sequences (pk) and (g^) in E\{p}, 
such that limpfc = limqi^ = p, the sequence (pk) is asymptotic to Ri, and 
the sequence {q^) is asymptotic to i?2- 

Proof. Let p G be an arbitrary point satisfying the two inequalities of 
Corollary 3.6 for all 7 G M and some > 0. That corollary states that the 
set of such points has full 'H'^-measure. 

Let 7 G M be arbitrary. Then there exists > such that 

W{E n {B{p, r) \ {Wp{r, r, ??) U Wp{^ + tt; r, r?)))) ^ ^ 
limsup > U. 

We may assume that r/ < 7r/2. In particular, for a fixed r > 0, |j is an 
accumulation point for 

E n (Wp(7 + 7r/2; r, ^/2 - r?) U Wpij - ^/2; r, 7r/2 - r?)). 

By Lemma |2.1[ there exist a ray Ri , emanating from p and passing through 
a point in 

F = dB{p, r) n (Wp(7 + 7r/2; r, tt/2 -i])LI Wp{j - tt/2; r, 7r/2 - r?)), 

and a sequence (pk) with pk £ E \ {p}, limp^ = p, such that (pk) is asymp- 
totic to Ri. Clearly Ri is not contained in the line through p and re^'^. 

Let 7' G M be such that Ri contains the point re^'^ . Then we can apply 
the same argument as above for 7' in place of 7 to produce a ray R2 and a 
sequence (qk) as in the statement of the theorem. The theorem follows. □ 

Theorem 3.8. Let U O M? be an open set and F : U ^ M? be a C^- 

differentiable map. Let E U be a closed subset that consists of all fixed 
points of F. We assume that the Hausdorff dimension of E is s, 1 < s <2. 
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Then for every s' , 1 < s' < s, there exists an s' -set E' C E, such that 
DpF = id for every p €z E' . 

Proof. Let s' ,1 < s' < s he arbitrary. Then T-l^ [E] = oo, and therefore 
imphes that there exists an s'-set Ei <Z E. Since 1 < s' < 2, 
yields the existence of a full measure set E' C Ei with the 



3.2 



3.7 



Theorem 
Theorem 

following property. For each point p £ E' there are two rays Ri and i?2, 
emanating from p and not contained in the same line, and two sequences 
(pk) and (qk) in E' \ {p} with limp^ = limq^ = p, {p).) is asymptotic to 
and {qk) is asymptotic to i?2- 

Let vi and V2 be the unit vectors that give the directions of Ri and R2, 
respectively. Note that vi and V2 are linearly independent. According to 
Lemma 2.2, for every p £ E' , 

[p) = hm 1 1 = lim r = vi , 

fc^oo \pk — p\ fc-s>oo \pk — p\ 

since E' C E, and (pk) is asymptotic to Ri. Likewise, Fv^{p) = V2. 

Since vi and V2 form a basis in E?, for every v in we have v = 
civi + C2V2, where ci, C2 G M. Thus, for every p £ E' , 

DpF{M) = ciDpF(vi)+C2L>pF(v2) = ciFvi(p)+C2Fv,(p) = C1V1+C2V2 = v, 

i.e., DpF = id. □ 
Using a similar argument, one can prove the following result. 

Theorem 3.9. Let U C R"^ be an open set and f,g:U—f-M.be two C - 
differ entiahle functions. We assume that E is an s-set for 1 < s < 2 
and f = g on E. Then there exists a full Ti'^ -measure subset E' Q E with 
the following property. For each p £ E' there are two linearly independent 
unit vectors vi and V2, such that fvAp) = gvAp), j = 1,2. 



Proof. Let E' <^ E he the full measure set that comes from Theorem 3.7 



and let p £ E' he arbitrary. Let Ri and R2 be two rays, emanating from p 
and that are not contained in the same line. Let vi and V2 be the linearly 
independent unit vectors that give the directions of Ri and R2, respectively. 
Let Rj, j = 1 or 2, be one of the rays, and (pk), Pk & E' \ {p}, limpk = p, 
he an asymptotic sequence to Rj. Then, by applying Lemma 2.2 we get 

f^(p) = lini - = 9iPk)-9{p) ^ 

\pk - p\ \pk -p\ ' 

as desired. □ 



We note that the main ingredient of the proofs of Theorems 3.8 and 3.9 



is the existence of sets of points at which no tangent line exists. Therefore 
we immediately have the following, more general, results. 

Theorem 3.10. Let U C be an open set and F : U ^ R? be a - 

differentiable map. Further, let E (1 U be a closed subset that consists of 
all fixed points of F. Then DpF = id at every p £ E such that E has no 
tangent line at p. 



8 



SERGEI MERENKOV AND VADIM ZHARNITSKY 



Theorem 3.11. Let U <^ R"^ be an open set and f,g: U — )• M be C^- 
differentiable functions. Then for every p £ E such that E does not have a 
tangent line atp, there are two linearly independent unit vectors vi and ^2, 
such that f^.{p) = g^.{p), j = 1,2. 

4. Proofs of the main results 

Assume that T-L^{P^) / for some s G (1,2]. On the set C [/ we have 
T^{p) = p. We may assume that the annulus U = x I \s smoothly 
embedded in the plane. We still denote the local coordinates by (t, 6). Since 
the billiard boundary is , an elementary argument gives that the map 
is C^-differentiable, in particular DpT^ exists at each p £ U. We need the 
following result. 

Proposition 4.1. [5, Section 4] IfT^{t,e) = {t,9) and D(^t,e)T^ = id, then 
(3) kit)L{t,e) = 2 sin^ (9), 

where k{t) is the boundary curvature at t and L{t,0) is the length of the 
three-period orbit {t,6). 

The function L in the above statement is only defined on P^. However, 
since the billard boundary is smooth, the function L can be extended to 
a C^-differentiable function in a neighborhood of every three-period orbit. 
Indeed, one can just replace the second reflection with the straight line 
connecting the second collision point {X2) with the initial point (xq); see 
Figure [T] 

Now, since the billiard boundary is C^, both sides of Equation ([s]) are 
defined and C^-differentiable in an open set containing P^. Note, however, 
that, in general. Equation (|3| does not have to hold in this whole open set. 

4.1. Proof of theorem |l.l[ Assume to the contrary that dim-^(P'^'' — " 



with 1 < s < 2. Note that the set P is closed. Then, by Theorem 3.8, for 
any s' , I < s' < s, there exists a set E' C P^, such that D^i q-^T'^ = id for 



any {t,9) G E' . According to Proposition 4.1, on this set, the identity 

k{t)L{t,0) = 2sm^{9) 

holds. 



We apply Theorem [3l)| to E' C p3 g^^^ ^.j^g functions f{t, 9) = k{t)L{t, 9), 
g{t,9) = 2sin^(6'). It gives a full ^^'-measure subset E" C E' such that 
there are two linearly independent unit vectors vi and V2 with fv^ip) = 
9v^{p), j = 1,2, for any p £ E" . In particular, since / and g are C^- 
differentiable, we have the equality of the partial derivatives: 

^^(k{t)L{t,9)) = ^{2sm'{0)). 

This leads to a contradiction since dgL{t,9) = by Fermat's principle and 
dQsin'^{9) = only if 9 = 0,7r/2,7r. However, there are no three-period 
orbits for these values of 9. □ 
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Figure 1. The periodic orbit (xq, xi,X2) has a weU defined 
length function L (the perimeter). A nearby orbit does not 
have to be three-periodic. To extend the length function to 
such orbits, replace the third segment with the one connect- 
ing the second reflection point with the starting point (dashed 
line). The extended length function is then the perimeter of 
the obtained triangle. 



4.2. Proof of theorem |l.2[ We may assume that < n^iP^) < oo. Let 
E he the set that consists of all points p such that P^ does not have a 

tangent line at p. liT-l^{E) = 0, we are done. If T-L^{E) > 0, the proof follows 
the lines of the proof of Theorem |l.l[ where one should replace Theorems 3.8 
and |3.9| by Theorems 3.10 and |3.11[ respectively. □ 
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